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Abstract. We report a neutron diffraction study of the magnetic phase transitions 
in the charge-density-wave (CDW) TbTe3 compound. We discover that in the 
paramagnetic phase there are strong 2D-like magnetic correlations, consistent with 
the pronounced anisotropy of the chemical structure. A long-range incommensurate 
magnetic order emerges in TbTe3 at T mag \ = 5.78 K as a result of continuous phase 
transitions. We observe that near the temperature T mag \ the magnetic Bragg peaks 
appear around the position (0,0,0.24) (or its rational multiples), that is fairly close to 
the propagation vector (0, 0, 0.29) associated with the CDW phase transition in TbTe3. 
This suggests that correlations leading to the long-range magnetic order in TbTe3 are 
linked to the modulations that occur in the CDW state. 
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1. Introduction 

The RTe3 family of compounds (R=rare earth) have recently attracted renewed interest 
as a model system for layered (two-dimensional) charge-density-wave (CDW) materials. 
RTe3 crystallizes in an orthorhombic structure, composed of double layers of planar 
Te- sheets separated by corrugated R-Te layers. The average chemical structure can 
be described using the Cmcm space group [1] (in this setting the lattice parameters a 
and c are close to each other, whereas b is approximately 6 times longer), although in 
these materials an incommensurate lattice modulation with a wave vector q c ~ 2/7c* is 
observed below the phase transition into the CDW state [21 E]- Such a CDW state with 
modulations along the c-axis is present in all RTe3 materials. However, the members 
with the heaviest rare-earth elements exhibit a second CDW phase transition at lower 
temperatures that is characterized by a modulation wavevector q a ~ l/3a* [HE]. The 
temperatures of these two CDW transitions show opposite trends as a function of the 
R-atom mass. Whereas Tqdwi decreases towards heavier members of the family {i.e., 
going from La to Tin), the Tqdv/2 associated with the a- axis incommensurability is 
higher for heavier compounds [U [6]. For the specific compound studied in this report, 
TbTe3, transport and diffraction experiments yield Tcdwi — 336 K. Although transport 
measurements do not clearly reveal the presence of a second CDW transition, STM 
measurements performed at 6 K do show an ordering pattern that is associated with 
the wavevector ~ 2 /3a* [5]. More recent high resolution x-ray diffraction measurements 
confirm the presence of a transverse CDW at low temperatures, with wave-vector 
~ 0.683a*, though Tqdw2 is at present unknown [TJ. 

The RTe3 family appears to be a classic CDW system, for which the CDW 
wavevector corresponds to an enhancement of the generalized susceptibility x(l)i which 
is largely driven by FS nesting [H [9j [10] . The enhancement is, however, far from being a 
divergence, suggesting an important role for strong electron-phonon coupling pi)]. The 
Fermi surface is composed of states associated with the double Te layers, and is therefore 
similar for all members of the series. The principal role of the rare earth ion R appears 
to be chemical pressure, which only modestly affects the resulting CDW wavevectors 
Pi- 

In addition to hosting an incommensurate CDW, for magnetic rare earth ions, 
RTe3 also hosts long range antiferromagnetic order at low temperatures. The magnetic 
phase transitions of RTe3 have been studied using magnetisation [HI dU [121 [13] - 
calorimetry [61 [UJ [13] and electrical resistivity [61 [HI [121 113 • Using these macroscopic 
techniques the temperatures of the magnetic transitions have been determined and a 
phase diagram summarizing the temperatures of CDW and magnetic phase transition 
of RTe3 has been established in Ref. [6]. However, the nature of the long-range magnetic 
order in this family of compounds has not yet been studied by diffraction techniques, 
and the effect of the incommensurate lattice modulation on the magnetic structure 
is unknown. To bridge this gap we have performed neutron scattering experiments 
in the representative compound TbTe3. The choice of this material was dictated by 
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the following reasons. In order to establish possible relationship of the propagation 
vectors associated to the CDW state and of the long-range magnetic order one needs 
to study the material that has reasonably close values between Tcdwi an d Tjy. Based 
on this condition, the DyTe 3 and TbTe 3 are both attractive candidates according to 
their phase diagram [6J. DyTe3 undergoes two magnetic phase transitions at T~3.6 K 
and T~3.45 K [6\. However, due to high absorption of Dy the neutron measurements 
on DyTe3 are too challenging [H]. TbTe3 exhibits three closely located magnetic phase 
transitions at the following temperatures: T mag i = 5.78 K, T mag 2 = 5.56 K and T magS = 
5.38 K [6\. Here, we present a study of the magnetic phase transitions in TbTe3 using 
powder and single crystal neutron diffraction. 

2. Experimental techniques 

Single crystals of TbTe3 were grown by slow cooling a binary melt, as described 
elsewhere [TT]. As the material is rather air-sensitive, the TbTe3 powder was obtained 
by crushing the single crystals in He-atmosphere. The powder was immediately sealed 
in a cylindric vanadium can of 6 mm in diameter used for the measurements. 

Powder neutron diffraction experiments were performed at the DMC cold-neutron 
diffractometer [T5] (neutron spallation source SINQ [16], PSI) in the temperature range 
1.5 - 60 K. Most of the data were collected with neutron wavelengths of A = 2.46 A, 
giving access to the wave vectors range 0.1-3.4 A -1 . Typical exposure times were ~ 12 
hours. 

The experiments on the single crystals of TbTe3 with size of roughly ~7x8x2.5 
mm 3 were performed at the TriCS single crystal diffractometer [17] . A pyrolytic graphite 
(PG) monochromator was used with neutron wavelength A = 2.32 A. A 120 mm long 
PG filter was installed in the beam in order to ensure full suppression of higher-order 
neutrons. The temperature range of interest for these measurements is T ~ 2 — 8 K, 
because the three magnetic phase transitions are close to each other in the range 5 — 6 K. 
This interval was scanned with steps of ~ 0.05 K. To ensure the required accuracy in 
temperature an "orange" -type He flow cryostat was used. One of the samples was 
aligned in the [H,K,0] plane and a second sample was aligned in the [0,K,L]. The normal 
beam geometry was employed, tilting the detector in the range of -10. ..10 deg. This 
allowed to access reflections with L=±l and H=±l, respectively. 

3. Powder Diffraction Results 

The data at 60 K was taken as a reference for the scattering in the paramagnetic phase of 
TbTe3 . The average chemical structure of TbTe3 was refined with Fullprof [18] within the 
Cmcm space group following a structural model of the RTe3-type materials developed 
in Ref. |19j . This analysis indicates the presence of several preferred orientations in the 
sample, impeding high-quality refinements of both chemical and magnetic structures. 
Nevertheless, the lattice parameters obtained from the data a = 4.3050 ± 0.00015A , 
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Figure 1. Temperature dependence of the difference-patterns with respect to the 
data at the reference temperature of 60 K. The inset emphasizes the changes of the 
diffraction pattern in the range of wavevectors 0.2 - 2A . 



b = 25.33757 ± 0.0012A , and c = 4.28024 ± 0.00012A are in agreement with those 
published earlier [TU]. In what follows we concentrate on the differences of the data 
taken at temperatures lower than 60 K. In this experimental setup the low-temperature 
changes in the chemical structure of TbTe3 are not resolved. 

Figure [Q shows difference-patterns at selected temperatures, obtained by 
eliminating the contribution from the chemical structure with the subtraction of the 
diffraction pattern at 60 K. As expected from the macroscopic properties of TbTe3, 
magnetic Bragg peaks appear in the diffraction patterns collected below T mag i= 5.78 K. 
Furthermore, relatively sharp asymmetric peaks appear in the diffraction patterns even 
at temperatures slightly higher then T mag i (e.g., the patterns taken at 6.2 K and 
7 K). As shown in Fig. [TJ these unusual peaks have an extended shoulder towards 
higher wavevectors. Such scattering profiles from powders are typical for systems 
with pronounced quasi-two-dimensional (quasi-2D) properties, as observed e.g. in 
graphite [20] or in 2D magnetic materials [21]. Therefore, one may expect that in a 
relatively broad temperature range above T magl TbTe 3 exhibits quasi-2D behavior. The 
positions of the magnetic Bragg peaks are temperature-dependent and may be clearly 
distinct in different magnetic phases. This suggests that the magnetic phases occurring 
in TbTe3 are modulated and the propagation vector is locked-in at incommensurate 
position only below T mag3 . In addition, the asymmetric peaks above T magl are located 
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Figure 2. Indexed magnetic reflections for TbTe3 at 2 K in a powder diffraction 
pattern (the contribution from the chemical structure is eliminated by subtracting the 
powder spectrum taken at T=60 K). The indexed peaks were identified by single-crystal 
neutron diffraction experiments. Labels in the brackets are the (H, K, L) indices of the 
peaks given in terms of the average Cmcm structure. The peaks that are associated 
with the magnetic propagation vector q™ a9 = (0,0,0.21) are labeled in red, those 
associated with the magnetic propagation vector q™ 09 = (0, 0, 0.5) are shown in black, 
and finally, with q 3 " as = (0, 1, 0) - in green. Note that the Bragg peaks that are labeled 
for simplicity as (0,0,0.21), in fact have a non-zero component of modulation along 
the (< 0,K, >) direction and more precisely should be described as (0,0.01,0.21). 
See text and Fig. 2] for details. 



at a different wavevector as compared to magnetic Bragg peaks observed just below 
T mag \. This is best seen for the scattering profiles shown in Fig. [TJ in the vicinity of 
Q ~ O^A . 

Figure |2] shows the magnetic diffraction pattern measured from TbTe3 at 2 K. Some 
of the magnetic peaks could be indexed in terms of the average chemical cell and are 
labeled in Fig. [2] (due to the complexity of the pattern the use of single- crystal neutron 
diffraction data was essential for this step). Clearly, most of the magnetic Bragg peaks 
are at positions incommensurate with the average chemical structure of the material. It 
may be speculated that the broad magnetic peaks observed in the vicinity of Q — 0.9A 
and Q ~ 1.2 A are composed by many magnetic Bragg peaks which are located close to 
each other in wave-vector space, due to the rather large value of the lattice parameter 
b. We note here that among the magnetic Bragg peaks we could not identify any with 
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Figure 3. The temperature evolution of the intensity distribution taken in the vicinity 
of the (0,0,0.21) position of TbTe3. Vertical solid lines on both plots denote T mag3 — 
5.38 K. Note that below T mag 3 the reflection is incommensurate in both < 0, K, > 
and < 0, 0, L > directions. 



non-zero value of H. 



4. Single-Crystal Diffraction Results 

Taking into account the complexity of the powder diffraction patterns observed in 
magnetically ordered phases of TbTe3, there are considerable difficulties not only in 
developing a proper model of the arrangement of the Tb magnetic moments, but even 
in determining the propagation vectors in the magnetically ordered phases. In a trial 
to overcome these difficulties a series of single-crystal experiments were performed at 
the base temperature T=2 K, below T mag3 . Those reflections, which were successfully 
indexed at T=2 K, are labeled in Fig. |2j There was no attempt to index the 
peaks observed in powder diffraction patterns at higher temperatures. Instead, the 
temperature evolution of those peaks that were identified at T— 2 K was traced up to 
T ~ 7 K. 

Figure |3] shows false-color maps of neutron intensities taken in a close vicinity of 
the (0, 0, 0.21) incommensurate magnetic reflection in the temperature range 1.5 — 6 K. 
At the base temperature this reflection has incommensurate components both along the 
< 0, K, > and < 0, 0, L > directions. However, the incommensurate component along 
the < 0, K, > direction appears to be small and diminishes above T mag3 in a step-like 
way. Above T mag3 the incommensurate components along the < 0, 0, L > direction is also 
temperature-dependent. For a more quantitative analysis the scans for each temperature 
are fitted assuming a Gaussian shape for a Bragg reflection. The resulting temperature 
dependence of the position and intensity of the peak (0, 0, 0.21) are shown in Fig. HI The 
modulation vector along the < 0, 0, L > direction stays constant within the precision of 
the measurements below T mag3 . Above T mag3 the propagation vector increases smoothly 
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Figure 4. The temperature evolution of the propagation vectors (left column) and 
of the intensity (right column) measured around the position (0,0,21). Green symbols 
denote the position and the intensity of the (0,0 + 5,0.21) satellite, whereas black 
squares stand for the (0,0 — 5,0.21). Vertical dashed lines denote the temperatures of 
the magnetic phase transitions. 



and reaches the value of (0, 0, 0.242 ± 0.001) at T mag \. The modulation vector along the 
< 0, K, > direction is also constant (0, 0.01 ± 0.001, 0) below T mag3 , while above this 
temperature the component of the modulation vanishes. The intensity measured around 
the (0, 0, 0.21) position also appears to be nearly temperature-independent below T mag3 . 
Above this temperature however, the overall intensity observed in the vicinity of the 
(0, 0, 0.21) position drops by a factor of 2, as can be deduced from Fig.0b-d. Further the 
intensity gradually decreases and above T magl we could not detect any scattering above 
the background level around that position. In the whole studied temperature range the 
width of the peaks is limited by resolution. Gradual decrease of the Bragg intensity 
suggest a continuous character of the phase transition that the crystal undergoes at 
Tmagii whereas an abrupt change in magnetic intensity at T mag3 points to a first order 
phase transition. 

The magnetic Bragg peaks, characterized by the propagation vector (0,0,0.5), 
exhibit a qualitatively different behavior. Figure [5] shows the temperature dependence of 
the (0, 4, 0.5) Bragg peak in the temperature range 4 — 6 K as a representative example. 
Whereas below T mag3 the propagation vector is (0,0,0.5), above this temperature the 
position of the magnetic Bragg peaks becomes incommensurate in a step-like fashion as 
(0,0,0.5±(5) with 5 displaying a temperature dependence. The intensity of the (0,4,0.5) 
magnetic peak decreases abruptly at T mag3 and smoothly diminishes towards T magX . 
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Figure 5. The temperature evolution of the intensity distribution taken in the vicinity 
of the (0,4,0.5) position of TbTe3. Red triangles show the position and the intensity 
of (0,0,0.5 + S) satellite, while blue circles denote the position and the intensity of 
(0,0,0.5 — S) satellite. Vertical dashed lines denote the temperatures of the magnetic 
phase transitions. 



Weak magnetic peaks around the (0,4,0.5) position are still observed in paramagnetic 
phase up to ~ 6 K. 



5. Discussion and Conclusions 

We have performed a first study of magnetic phase transitions in TbTe3 by powder and 
single-crystal neutron diffraction. We find that in the paramagnetic phase, slightly 
above T magl = 5.78 K, there are pronounced 2D-like magnetic correlations. At 
Tmagi long-range magnetic order emerges as a result of a continuous phase transition. 
In all three magnetically ordered phases, incommensurate modulations are present. 
This observation is at variance with the typical behavior of unmodulated rare-earth 
intermetallic compounds (see e.g. [22j[23]). Incommensurate magnetic structures often 
appear in these materials just below the phase transition into the magnetically ordered 
state. However, in most cases magnetoelastic coupling and crystal-field effects typically 
result in a lock-in transition to a commensurate magnetic structure. The behavior found 
in TbTe3 only partially resembles these general expectations. As shown in Fig. [5] the 
magnetic propagation vector of the (0, 0, 0.5 ± 5)-type observed just below T mag i turns 
out to be locked-in below T mag3 into the simple antiferromagnetic position (0,0,0.5). 
However, the magnetic Bragg peaks observed below T magX near the position (0,0,0.24), 
stabilize at low temperature at the incommensurate position (0,0 + 5,0.21). This effect 
is possibly due to the incommensurate lattice modulation present in TbTe3 in the CDW 
state. 

The propagation vectors of the magnetic structures, which we succeeded to identify 
in TbTe3, have components either along the < 0, K, > or < 0, 0, L > directions, 
or a linear combination of both. We could not assign any of the magnetic peaks, 
observed in powder diffraction pattern, as a Bragg reflection with non-zero component 
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< H, 0, > of the propagation vector. Therefore, our results do not point towards a link 
of the propagation vector associated with the second CDW phase transition and of the 
magnetic order in TbTe3. Nonetheless, we discover that near the temperature T mag i the 
magnetic Bragg peaks appear around the positions (0,0,0.24) (or its rational multiples). 
This value is fairly close to the propagation vector (0, 0, 0.29) p[] associated with the 
high-temperature CDW phase transition, raising the possibility that correlations leading 
to the long-range magnetic order in TbTe3 might be linked to the modulated chemical 
structure in the CDW state. These results stimulate further work to refine the magnetic 
structure in this and related magnetic RTe3 compounds, with the ultimate goal of 
establishing how the CDW and magnetic order interact and coexist. 
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